Resolving handwriting from background printing using photometric stereo

We propose a scheme to resolve handwriting from background printing. The scheme detects the indentations made by the pen in the paper. Photometric stereo is used to recover the surface; a matched /lter and classi/er are used to detect the stroke indentation. We assess the e0ect of uniform and textured backgrounds on the recovery of the stroke and test the scheme on practical examples. The technique was found to work well with script written with a ballpoint pen and could e0ectively suppress even dark and strongly textured backgrounds. We conclude that this is a useful complement to existing techniques for background removal and is especially useful when there is no template available. ? 2003 Pattern Recognition Society. Published by Elsevier Science Ltd. All rights reserved.